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Abstract — This paper demonstrates that if the restricted isom- 
etry constant Sk+i of the measurement matrix A satisfies 
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then a greedy algorithm called Orthogonal Matching Pursuit 
(OMP) can recover every it-sparse signal x in K iterations from 
Ax. By contrast, a matrix is also constructed with the restricted 
isometry constant 

Sk+i = , — 



such that OMP can not recover some A'-sparse signal x in K 
iterations. This result positively verifies the conjecture given by 
Dai and Milenkovic in 2009. 

Index Terms — compressed sensing, restricted isometry prop- 
erty, orthogonal matching pursuit, sparse signal reconstruction. 



I. Introduction 

COMPRESSIVE sensing is a new type of sampling theory. 
It shows that it is highly possible to reconstruct sparse 
signals and images from what was previously believed to be 
incomplete information [ 2 1 . Let x 6 R n be a signal, we want 
to recover it from a linear measurement 



Ax 



(1) 



where A is a given m x n measurement matrix. In general, 
if m < n, the solution of (fl~|i is not unique. To recover x 
uniquely, some additional assumptions on x and A are needed. 
We are interested in the case when x is sparse. Let ||x|| denote 
the number of nonzero entries of x. We say that a vector x 
is K-sparse when ||x||o < K. To recover such a signal x, 
a natural choice is to seek a solution of the Iq minimization 
problem 

min ||x||o subject to Ax = y 

X 

where A and y are known. To ensure the K-sparse solution is 
unique, we would like to use the restricted isometry property 
introduced by Candes and Tao in Q. A matrix A satisfies 
the restricted isometry property of order K with the restricted 
isometry constant 5k if 5k is the smallest constant such that 

(l-S K )\\x\\l<\\Ax\\l<(l + S K )H\ 2 2 
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holds for all if -sparse signal x. If 82K < L the Iq mini- 
mization problem has a unique if-sparse solution 0. The Iq 
minimization problem is equal to the l\ minimization problem 
when 8 2 K < v2— 1 CO- Recently, Mo and Li have improved 
the sufficient condition to S2K < 0.4931 1181 . 

OMP is an effective greedy algorithm for seeking the 
solution of the Iq minimization problem. Basic references for 
this method are [6|, [10] and ifTTI . For a given m x n matrix 
A, we denote the matrix with indices of its columns in ft by 
Aq, We shall use the same way to deal with the restriction 
xn of the vector x. Let e, be the ith coordinate unit vector 
in R™. The iterative algorithm below shows the framework of 
OMP. 

Input: A, y 

Set: ft = 0, ro = y, 3 = 1 
while not converge 

- fij = fij-i U argmaxi |(Aej, 

- Xj = argmin z ||Ao 3 z - y|| 2 

- r, y ,1,, x, 

- 3 = J + 1 
end while 

x 0j = Xj, x n c = 
Return x 



Davenport and Wakin have proved that 5k- 



< 



sufficient for OMP to recover any .fT-sparse signal in K 
iterations [5|. Later, Liu and Temlyakov have improved the 
condition to 5k+i < t, — hn^ 17 1- By contrast, Dai and 

(l + V 2) v K 

Milenkovic have conjectured that there exist a matrix with 
Sk+i < -jj? and a X-sparse vector for which OMP fails in 
K iterations. This conjecture has been confirmed via numerical 
experiments in for the case K = 2. The main results of 
this paper are consisted by two parts. 
• We prove that 

5k+i < 



IK + 1 

is sufficient for OMP to exactly recover every X-sparse 
x in K iterations. 

For any given K > 2, we construct a matrix with 

1 

Vk 

where OMP fails for at least one X-sparse signal in K 
iterations. 
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II. Preliminaries 

Before going further, we introduce some notations. Suppose 
x is a if-sparse signal in W 1 . In the rest of this paper, we 
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assume that 



x = (xi, . . . ,x k ,0, . . . ,0) 



where X{ 7^ 0, i = 1,2, ... ,k, k < K. For a given X-sparse 
signal x and a given matrix A, we define 

Si := {Ae it Ax), i = l,...,n. 

Denote So '■= max^j! ,...,k} \Si\- The following lemma is 
useful in our analysis. 

Lemma 2.1: Suppose that the restricted isometry constant 
5k+i of a matrix A satisfies 

1 

OK+l < —j= 7, 

VK + 1 

then S > \Si\ for i > K. 

Proof: By Lemma 2.1 in UJ, we have 

\Si\ = \{Ae i ,Ax)\<S K+1 \\x\\ 2 for alH > K - ( 2 ) 
For the given i\~-sparse x, we obtain 




It follows 



{l-5 K+l )\\x\\l < (Ax, Ax) 

K 

= ^ ' Xi Si 
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< S VlC\\x\\ 2 . 



This implies 



(1- 6 K+ i)\\x\U 
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(3) 



It follows from (f5]l and (f3]) that the lemma holds. ■ 

III. Main Results 

This section establishes the main results of this paper. 

Theorem 3.1: Suppose that A satisfies the restricted isom- 
etry property of order K + 1 with the restricted isometry 
constant 

, 1 

°K+l < —j= r, 

VK + 1 

then for any if-sparse signal x, OMP will recover x from 
y = Ax. in K iterations. 

Proof: Consider the first iteration, the sufficient condition 
for OMP choosing an index from { 1 , . . . , K} is 

S > \Si\ for all i > K. 

By Lemma |2~T1 5k+i < v ^ +1 guarantees the success of the 
first iteration. OMP makes an orthogonal projection in each 



iteration. By induction, it can be proved that OMP selects a 
different index from {1,2,..., K} in each iteration. ■ 
Theorem 3.2: For any given positive integer K > 2, there 
exist a K-sparse signal x and a matrix A with the restricted 
isometry constant 

6k+i 



1 



K 

for which OMP fails in K iterations. 

Proof: For any given positive integer K > 2, let 



A = 



( 
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(K+l)x(K+l) 



By simple calculation, we get 



A A = 



IK 



K 



J_ 

K 
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(K+l)x(K+l) 



where A T denotes the transpose of A. It is obvious that the 
eigenvalues {Ai}^ 1 of A T A are 

Ai = • • • = Xk-i = 1, Ak = 1 jft and \ K +\ = 1 + -ts 



ik 



/K 



K 

Therefore, the restricted isometry constant Sk+i of A is 
Let 

x = (1,1,...,1,0) T eR K+1 . 

We have 

Si = (Aei,Ax) = 1 for all i € {1, . . . , K + 1}. 

This implies OMP fails in the first iteration. Since OMP 
chooses one index in each iteration, we conclude that OMP 
fails in K iterations for the given matrix A and the vector x. 

■ 

Remark 3.3: It is challenging to design a measurement 
matrix having a very small restricted isometry constant Sk+i', 
and Theorem 13.21 shows that this kind of requirement is 
necessary. However, if we select multiple indices per iteration, 
we can recover the if-sparse signal given in Theorem 13.21 in 
K iterations. Actually, this technique has been widely used in 
many related greedy pursuit algorithms, such as CoSaMP |9| 
and Subspace Pursuit algorithm [4|. 
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